Abstract
Although activities of daily living are often difficult for individuals with cognitive impairments, their autonomy and independence can be fostered through interactive technologies. The use of traditional computer interfaces has however proved to be difficult for these users, bringing to the surface the need for novel interaction methods. This paper proposes Let’s Cook, an innovative Augmented Reality game, designed to teach children with cognitive impairments how to prepare simple meals, following a playful approach. Let’s Cook supports multimodal interaction techniques utilizing tangible objects on a table-top surface, as well as multimedia output. Additionally, it can be personalized to accommodate the diverse needs of children with cognitive impairments by employing individual user profiling. The system is currently installed in the kitchen of the Rehabilitation Centre for Children with Disabilities in Heraklion, Crete where it was evaluated by the students.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The detailed evaluation questions and their statistical analysis will be reported elsewhere due to space limitations.
References
Braddock, D., Rizzolo, M.C., Thompson, M., Bell, R.: Emerging technologies and cognitive disability. J. Spec. Educ. Technol. 19(4), 49–56 (2004)
Scherer, M.J.: Assistive Technologies and Other Supports for People with Brain Impairment. Springer, New York (2011)
Salah, A.A., Schouten, B.A., Göbel, S., Arnrich, B.: Playful interactions and serious games. J. Ambient Intell. Smart Env. 6(3), 259–262 (2014)
Göbel, S., Hardy, S., Wendel, V., Mehm, F., Steinmetz, R.: Serious games for health: personalized exergames. In: Proceedings of the 18th ACM International Conference on Multimedia, pp. 1663–1666. ACM (2010)
Lindley, C.A., Sennersten, C.C.: Game play schemas: from player analysis to adaptive game mechanics. In: Proceedings of the 2006 International Conference on Game Research and Development, pp. 47–53. Murdoch University (2006)
Dunleavy, M., Dede, C., Mitchell, R.: Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. J. Sci. Educ. Technol. 18(1), 7–22 (2009)
Ntoa, S., Leonidis, A., Korozi, M., Papadaki, E., Adami, I., Margetis, G., Antona, M., Stephanidis, C.: Analysis and design of three multimodal interactive systems to support the everyday needs of children with cognitive impairments. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9177, pp. 637–648. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20684-4_61
Mechling, L.C.: Assistive technology as a self-management tool for prompting students with intellectual disabilities to initiate and complete daily tasks: a literature review. Educ. Train. Dev. Disabil. 252–269 (2007)
Lopresti, E.F., Mihailidis, A., Kirsch, N.: Assistive technology for cognitive rehabilitation: state of the art. Neuropsychol. Rehabil. 14(1–2), 5–39 (2004)
Lopresti, E.F., Bodine, C., Lewis, C.: Assistive technology for cognition [Understanding the Needs of Persons with Disabilities]. Eng. Med. Biol. Mag. IEEE 27(2), 29–39 (2008)
Brandão, J., Cunha, P., Vasconcelos, J., Carvalho, V., Soares, F.: An augmented reality gamebook for children with autism spectrum disorders. In: The International Conference Focused on e-Learning in the WorNplace (2015)
Silva, G.F.M., Raposo, A., Suplino, M.: PAR: a collaborative game for multitouch tabletop to support social interaction of users with autism. Procedia Comput. Sci. 27, 84–93 (2014)
Chang, Y.J., Kang, Y.S., Huang, P.C.: An augmented reality (AR)-based vocational task prompting system for people with cognitive impairments. Res. Dev. Disabil. 34(10), 3049–3056 (2013)
Mansor, E.I., De Angeli, A., De Bruijn, O.: Little fingers on the tabletop: a usability evaluation in the kindergarten. In: 2008 3rd IEEE International Workshop Horizontal Interactive Human Computer Systems, TABLETOP 2008, pp. 93–96. IEEE (2008)
Marco, J., Cerezo, E., Baldassarri, S., Mazzone, E., Read, J.C.: Hybrid games: designing tangible interfaces for very young children and children with special needs. In: Nijholt, A. (ed.) More Playful User Interfaces, pp. 17–48. Springer, Singapore (2015). https://doi.org/10.1007/978-981-287-546-4_2
Jang, H.B., Kim, J.W., Lee, C.W.: Augmented reality cooking system using tabletop display interface. In: International Symposium on Ubiquitous VR, p. 1 (2007)
Zidianakis, E., Antona, M., Paparoulis, G., Stephanidis, C.: An augmented interactive table supporting preschool children development through playing. Proc. AHFE Int. 2012, 21–25 (2012)
Poutouris, E., Korozi, M., Leonidis, A., Louloudakis, N., Stephanidis, C.: ConstrAct: an educator-oriented design studio for ambient educational games. In: Proceedings of the 9th Annual International Conference on Education and New Learning Technologies, pp. 8475–8484, EDULEARN 2017 Proceedings (2017)
Drever, E.: Using Semi-Structured Interviews in Small-Scale Research. A Teacher’s Guide (1995)
Lancioni, G.E., O’Reilly, M.F., Seedhouse, P., Furniss, F., Cunha, B.: Promoting independent task performance by persons with severe developmental disabilities through a new computer-aided system. Behav. Modif. 24(5), 700–718 (2000)
Mechling, L.C., Gast, D.L., Seid, N.H.: Using a personal digital assistant to increase independent task completion by students with autism spectrum disorder. J. Autism Dev. Disord. 39(10), 1420–1434 (2009)
Miyawaki, K., Sano, M., Yonemura, S., Matsuoka, M.: A cooking support system for people with higher brain dysfunction. In: Proceedings of the ACM Multimedia 2009 Workshop on Multimedia for Cooking and Eating Activities, pp. 47–52. ACM (2009)
Ju, W., Hurwitz, R., Judd, T., Lee, B.: CounterActive: an interactive cookbook for the kitchen counter. In: CHI 2001 Extended Abstracts on Human Factors in Computing Systems, pp. 269–270. ACM (2001)
Acknowledgments
This work is supported by the FORTH-ICS internal RTD Programme ‘Ambient Intelligence Environments’.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Papadaki, E., Ntoa, S., Adami, I., Stephanidis, C. (2018). Let’s Cook: An Augmented Reality System Towards Developing Cooking Skills for Children with Cognitive Impairments. In: Guidi, B., Ricci, L., Calafate, C., Gaggi, O., Marquez-Barja, J. (eds) Smart Objects and Technologies for Social Good. GOODTECHS 2017. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 233. Springer, Cham. https://doi.org/10.1007/978-3-319-76111-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-76111-4_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-76110-7
Online ISBN: 978-3-319-76111-4
eBook Packages: Computer ScienceComputer Science (R0)